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The error statistics from data-transmission field tests on the telephone 
network may be compactly represented by about one dozen parameters. 
These relate to a model of the telephone network in which there are three 
distinct channels. The errors in binary data on each channel are produced 
by a renewal process in which a bit-error is a renewal event. The mixture 
of three such channels allows a close fit to the error statistics for a large 
range of block lengths. It is not implied that the errors on the telephone 
network are actually produced by such processes, but merely that they may 
be conveniently and compactly represented by them. 

Use of this model simplifies the analysis of error-control systems and 
the determination of error rales for error-control codes. In this paper the 
model is applied to study the effect that interleaving (time division multi- 
plexing) has on the effectiveness of error -correcting codes. 

I. INTRODUCTION 

In the study of errors on data communication channels, several 
mathematical models of the error process have been proposed. Gilbert 1 
proposed a two-state Markov process, and Berger and Mandelbrot 2 have 
employed a Pareto distribution to fit data collected from the German 
telephone network. Sussman 3 has applied a Pareto fitting to part of the 
Alexander-Gryb-Nast data. 4 Common to the models of Gilbert and 
Berger-Mandelbrot is the assumption that the error process is of the 
renewal type wherein the state of a bit-error is the renewal event whose 
occurrence frees the process from dependence upon past history and 
starts it anew. In such models the distributions of lengths of error-free 
intervals (gaps) determine the processes, because the lengths of the gaps 
before and after an error are independently distributed. One may calcu- 
late from this distribution the probabilities P(m,ri) that m bit-errors 
occur in a block of n consecutive bits. These probabilities are useful 
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in the analysis of error-control methods for data communications 
systems. 6 

On the telephone network, as exemplified by the Alexander-Gryb- 
Nast (AGN) data, the P(m,n) for individual calls are, as noted in Ref. 5, 
quite diverse in nature. This suggests that there are several error proc- 
esses involved. In fact, the combined AGN data cannot be described by 
just one error process of the renewal type but require the mixture of 
several such processes for a satisfactory description. The mixture of a 
collection of processes is determined by a corresponding set of channels 
on which the separate error processes act and specification of the proba- 
bilities of being assigned the various channels when placing a call (the 
assignment, and hence the error process acting, is fixed for the duration 
of the call) . 

The purpose of the present paper is to show that in this way the use 
of three distributions for gap lengths can yield satisfactory approxima- 
tions to the probabilities P(m,n) for the telephone network. This cannot 
be accomplished with just one or two distributions, and conceivably 
four or more might be required in some cases. The P(m,n) for renewal 
processes depend heavily on the first few values of the gap-length dis- 
tribution. Because of this there is some choice of distributions for 
satisfactory models of the telephone network. Noting how various 
gap-length distributions affect the P(m,n) distributions, we select 
three gap-length distributions with appropriate weightings to represent 
the combined switched telephone network. This selection gives excellent 
agreement to P(m,n) over a wide range of block lengths n. To exemplify 
further this means of representing the telephone network we apply it 
also to the To wnsend- Watts (TW) data given in Ref. 6. 

In the present paper we do not attempt to optimize the degree to 
which the models represent the telephone network. Rather, we attempt 
to demonstrate the feasibility of such representations and note that a 
better accuracy of fit would hardly affect the applications suggested. 
Also, no attempt is made to associate the parameters with particular 
causes, such as type of exchange or calling distance, etc. These goals 
would be the object for future work. We do suggest, however, that drop- 
outs (momentary open-line conditions) and the test words used in field 
tests are at least partially the cause for the hump in the P(m,ri) curves 
at m near n/2. 

II. RENEWAL-TYPE ERROR PROCESSES 

For a renewal error process, the lengths of successive gaps are inde- 
pendent and distributed according to a common distribution. Let p(k) 
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be the probability that a gap length is k — 1, i.e., p(k) = Pr (0 _1 1 | 1) 
where 1 denotes an error-bit, a correct bit and 0* denotes i consecutive 
0's. 
Let 

P(k) = Zp(m) 

so that P(k) is the probability that at least k — 1 0's follow a given 
error [i.e., P(k) = Pr (0* -1 | 1)]. Now, if pi is the unconditional proba- 
bility of a bit-error, then p x P(k) = Pr (1) Pr (0 fc_1 | 1) is the probability 
of 10*~\ But, because of the independence among gap-lengths of a 
renewal process, order is irrelevant and it is clear that the events 10 _l 
and fc-1 l are equiprobable. Hence, piP(fc) = Pr (0 fc-1 l). To obtain the 
value of pi , note that p\ = l/k where k, the average distance to the 
next error, is equal to 

jt k P (k). 

The probabilities of individual error patterns of a renewal process 
are easily calculated (but we do not make use of these here). For ex- 
ample, consider a block f of n consecutive bits which contains m bit- 
errors and, as in Ref. 5, p. 1985, let a be the number of 0's before the 
first 1 in f , c the number of 0's following the last 1 in f and 6, (t = 1, 
• • ■ , m — 1) be the number of 0's between consecutive l's in f. Then, 
the probability of f 's occurrence is given by 

Pr (f) = Pl P(a + 1) (n p(bi + 1)1 P(c + 1). 



Calculations of the above sort may be of use in evaluating both error- 
correcting and error-detecting codes on renewal-type channels. For more 
general, but approximate, applications, the probabilities P(m,n) that 
m bit-errors occur in a block of length n are of use. To calculate these 
we may use recurrence relations or generating functions as follows. 

First, let R{m,n) be the probability that m — 1 errors occur in the 
next n — 1 bits following an error. Thus, R(l,n) = P(n) for n ^ 1, and 

n—m+l 

R(m,n) = 2 p(k)R(m — l,n — k) 
k=i 

for 2 ^ m ^ n. 

Now, 
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n— m+1 

P(m,n) = X) PiP(k)R(m,n - k + 1) 

k=i 

whenever 1 ^ m ^ n. 

Computer programs for computing P(m,n) from the above recurrence 
relations have been written and used in obtaining the data presented 
later in this paper. 

An alternate approach to the above relation is through generating 
functions. If we let g(z) and G(z) be the generating functions associated 
with p(k) and P(k + 1) respectively 

(i.e., 0(2) = Ep(fc)2* and G(z) - E P(/c + 1)2*) 

A-=l k=0 

then, from Ref. 7, p. 249, we have 



Letting 



we obtain that 



1—2 



H m (z) = Y, P(m,n)z n 



H m (z) = Pl zG(z)g(z) m - 1 G(z) 



considering that m errors involve m — 1 gaps in a total number of bits 
adding up to n and that the generating function for a convolution of 
variables is the product of their associated generating functions. [pizG(z) 
is the generating function for the probabilities of the events 'l, g(z) 
is that of fc_1 l | 1 and G(z) is that of 0* | 1.] 
Thus, we obtain 

ff-w-iwpTV^Vir 4 . 

Calculation of P(m,ri) from this generating function is rather incon- 
venient. The recurrence equations are generally preferred in practice. 

III. A REPRESENTATION OF THE TELEPHONE NETWORK 

In both of the data-transmission field-test programs on the telephone 
network, data calls were placed on a variety of circuits and bit-errors 
were recorded. In Refs. 5 and 6 the composite effects of these are repre- 
sented by the P(m,n) probabilities. Fig. 1 shows P(ra,31) for these two 
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Fig. 1 — / J (hi ,31) for field test data. 



field tests and is typical of P(m,n) for other intermediate block lengths 
n. These curves appear to have three separate segments: an initial 
segment with a steep slope, an intermediate segment with a smaller 
slope, and a terminal hump and tail. Using the recurrence equations of 
the previous section, the P(w,31) curves for the three gap-length dis- 
tributions (determined by trial and error) given in Table I were calcu- 
lated and are displayed in Fig. 2. The unconditional bit-error rate for 
each curve is taken to be that of the AGN data. In so doing we essen- 
tially assume that the tails of the gap-length distributions are appro- 
priately tailored. The tails of these distributions, of course, do not 
influence P(m,n) when n is not too large. Each of these three curves is 
more-or-less parallel to the respective first, second or third segment of 
the P(ra,31) curve for the AGN data. They are to be added together, 
after multiplication by suitable weighting factors, to produce our 
approximation to the AGN curve. By trial and error, we find that weight- 
ing factors of 50, 25, and 25 per cent respectively give the close fit which 
is shown in Fig. 3 for block length 31 and again in Figs. 4-7 for some 
other block lengths. This trial and error procedure of finding curves of 
the right shape and then appropriate weighting factors represents a 
simple attempt to approximate the P(m,n) curves of the AGN data 
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Table I — Gap-Length Distributions p(k) for AGN Model 



k = 


l 


2 


3 


4 


5 


>5 


Initial segment 
Intermediate segment 
Hump 


0.12 
0.40 
0.56 


0.06 
0.20 
0.24 


0.0 

0.10 

0.06 


0.0 

0.05 

0.0 


0.0 
0.0 
0.12 


~0 
«0 
«0 



over a wide range of block lengths n. It would be desirable to use analytic 
methods instead of trial and error in obtaining such approximations, but 
the number of parameters involved is large and the analytic expressions 
for P(m,ri) are cumbersome. Undoubtedly, appropriate programming 
techniques can be developed to improve upon our trial and error method. 
The gap-length distributions and weighting factors given in Table II 
furnish an approximate model for the TW data. Figs. 8-10 compare 
the original and the model at block lengths 10, 31, and 63. 

iv. choice and interpretation of component distributions 

Suppose the field test data we wish to represent by a mixture of 
different renewal processes have an unconditional bit-error rate pi and 
suppose that gap-length distributions p*(k) (the superscript is not an 
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Fig. 2 — P(m,31) for components of model. 
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Fig. 3 — P(w,31) for model of AGN datu. 

exponent) and weighting factors X, (i = 1, • • • , ./) have been decided 
upon. (Determination of p'(k) and X, will be discussed subsequently.) 
Then, let / J '(w,n) be calculated for each distribution p { (k) using the 
prescribed error rate p\ . For the model we then take 

j 

P(m,n) = £ \ i P i {m,n) . 

.=i 

Use of the common value pi in computing P*(m,n) does not imply that 
each distribution p'(k) has this bit-error rate, but is just a device to 
assure that the model has the same unconditional bit-error rate as the 
field-test data. In fact, since p*(k) is generally specified for only a few 
small values of k, we assume that p*(fc) for larger values of k is distrib- 
uted so that its real bit-error rate pi,i may be different from pi , and it 
is not used explicitly in our model. Incidentally, X.-pi represents the por- 
tion of the total error rate attributable to the channels with gap-length 
distribution p { (k) and we could say that the percentage of channels of 
this type is X',- where X'.pi,, = X,-pi . 

To choose candidate distributions p'(k) we must first observe some 
principles, pertaining separately to the segments i = 1,2,3, which are 
noted in the next few paragraphs. We begin by examining the simplest 
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Fig. 4 — P(m,8) for model of AGN data. 




Fig. 5 — P(m, 15) for model of AGN data. 
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Fig. 6 — P(m,47) for model of AGN data. 
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Fig. 7 — P(m ,93) for model of AGN data. 
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Table II — Gap-Length Distributions p(k) and Weighting 
Factors for TW Model 



Weighting Factor 


X 


k 


l 


2 


3 


4 


5 


>5 


Initial segment 
Intermediate segment 
Hump 


57% 
18% 
25% 


0.20 
0.35 
0.45 


0.10 
0.25 
0.25 


0.0 

0.15 

0.15 


0.0 

0.05 

0.10 


0.0 
0.0 
0.03 


«0 
«0 
«0 



case analytically, namely that of a gap-length distribution p(k) such 
that p(l) = a and p(k) W for fc > 1. Then the generating function 
g(z) for p(k) is essentially az and 

H m ( Z ) = Pl z [yz~J («*)-*. 

Determining the coefficient of z" in the above [using (1 — z)~ 2 = 1 + 
2z + 32 2 + 4z 3 + • • •] we obtain 

P(m,n) = p«x n ~ x [{n - m + 1) - 2a(n - m) + a 2 (n - m - 1)] 

which in a logarithmic plot as a function of m is almost a straight line. 
A distribution of this type with a small, or a slight modification 
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Fig. 8 — P(m,10) for model of TW data. 
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Fig. 9 — P(»i,31) for model of TW data. 
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Fig. 10 — P(»i ,63) for model of TW data. 
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thereof, may be useful in matching the initial segment of field test data 
as in the foregoing examples. In general, the initial segment of a P(m,n) 
curve which has the same general shape as our two field test examples is 
determined by a gap-length distribution p(k) having 5 to 40 per cent 
of the probability spread over the first three or four values of k. It is 
reasonable to assume also that p(k) is monotonically decreasing and 
that p(k) « for ft much larger than 4. 

For the intermediate segment of such a curve, the gap-length dis- 
tribution may contain between 70 and 80 per cent of the probability 
in the first four or five terms. A definite hump begins to appear in the 
P(m,n) curve when much over 90 per cent is contained in the same 
range. Amounts of 95 to 99 per cent produce humps as extreme as we 
note in our examples. 

The exact way in which p(k) is distributed over these first few terms 
can influence the shape of the P(m,n) curve considerably. In general, 
large values of p{\) cause the P(m,n) to remain large for a more ex- 
tended range of values of m. Beyond these few general remarks, the 
process of fitting remains a matter of trial and error. First we find gap- 
length distributions which give rise to P(m,n) curves which approxi- 
mate in shape the various segments of the curve we are trying to match. 
Then weighting factors are chosen so that when the various components 
are so weighted and added together, they yield numerical agreement 
with the desired curve. 

Berger and Mandelbrot 2 and Sussman have claimed that the error 
processes on the telephone network are indeed of the renewal type and 
they have some data to support this view. We have not investigated 
this matter, but we do note that for the AGN data the composite gap- 
length distribution given in Table III is approximated reasonably well 
by that for our model. Our model, however, has p(k) tt for k > 5, 
whereas for the AGN data p{k) & for k > 5. These observations neither 
confirm or deny the existence of renewal processes on the telephone 
network. The accuracy with which our model approximates the field 
data is, however, indirect support for the notion that the error processes 
are at least not widely different from renewal processes. 

The humps in the P(m,n) curves at m & w/2 are rather remarkable. 
We have suspected that they are at least partially due to drop-outs and 
to the nature of the error-recording procedures in the field tests. For 
example, in the AGN tests during a drop-out, the error pattern recorded 
would coincide with the test word (Ref. 8, p. 1402) and would appear as 
repetitions of 

111101111001011000010000110110. 
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* = 


1 


2 


3 


4 


5 


AGN data 
Model 


0.24 
0.20 


0.09 
0.14 


0.05 
0.04 


0.02 
0.01 


0.03 
0.03 



When this pattern is present, the gap-length distribution induced would 
be that given in Table IV. This is essentially the distribution we have 
used to produce the hump in our model for the AGN data (cf . Table I) . 
We found that it gave a slightly better fit than some other distributions 
we tried, but other distributions did yield rather good fittings. This is 
not sufficient evidence to conclude that the hump is entirely due to 
drop-outs but it does support the hypothesis that it is at least partially 
caused by them. 

One other tentative interpretation of our models for the AGN and 
TW data lies in the gap-length distributions for their initial segments. 
The term p(l) for the TW data is almost twice as large as that for the 
AGN data, which means that double errors would be more prevalent 
in the TW data. This is consistent with the occurrence of dibit errors 
for the four-phase data set employed in the TW tests. 8 

So many gap-length distributions seem to give reasonable approxima- 
tions to the intermediate segment of the P(m,n) curves of these field 
tests that it is difficult to ascribe much significance to them. They do, 
however, represent instances where errors have high probabilities of 
following other errors, thereby producing bursts. Very short drop-outs 
would offer one explanation, but there are no doubt others. 

The accuracy of our approximations is certainly sufficient for many 
purposes, and in particular for the estimation of error rates for codes 
by the methods given in Ref. 5. An advantage of the models which is 
somewhat independent of accuracy is the following. When the block 
length n is very large there are two defects in the P(m,n) values obtained 
directly from the field-test data. First, the plot of P(m,n) becomes 
erratic due to the small sample size afforded by the field-test data, and, 
second, the computer processing time to obtain P(m,n) becomes ex- 
cessive. On the other hand, P{m,n) computed from the model yields a 



Table IV — Gap 


-Length 


Distribution for 


Test Word 


k 


i 


2 


3 


4 


5 


>s 


P (k) 


0.563 


0.250 


0.062 


0.0 


0.125 


0.0 
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smooth curve with very little time required in the computations. This 
appears to be a significant advantage of representing the telephone 
network by way of mathematical models. 

V. ERROR RATES ON THE TELEPHONE NETWORK 

The use of P(m,n) in estimating error rates for error-detecting codes 
is described in Ref. 5. It has also been used for some error-correcting 
codes in Ref. 9. For error-correcting codes, the probability P e of in- 
correct decoding may be conveniently and usefully bounded in some 
cases. For example, if the code is capable of correcting all (m — l)-fold 
(or fewer) errors, then certainly P e ^ P(^ m,n) where 

n 

F(^ m,n) = XP(t» 

and n is the code's block length. 

In Ref. 5 we find another use for the probabilities P( ^ m,n). For an 
error-detecting code used with retransmissions for error correction, let 
P u be the probability of an undetected error and P T be the probability 
of retransmission. Then, 

P u & 2~ C P( ^ d,n) 

and 

P T & P(^ l,n) 

where d is the minimum distance of the code and c is the number of 
check bits in each code word. The above approximation for P u is best if 
c is small, n is moderately large, and the check bits are not too trivial. 
It may be used in some other cases but with special caution if either 
extremely low error rates are desired or n is quite large. 

Using the model for the AGN data, P( ^ m,n) vs n has been com- 
puted and displayed in Fig. 11 for m = 1, • • • , 10. Fig. 11 is useful for 
the kind of estimates indicated above and for other considerations in 
error-control systems (e.g., synchronization). 

VI. THE EFFECT OF INTERLEAVING ON ERROR RATES 

Time division multiplexing (interleaving) has often been considered 
as a means of enhancing the error-control effectiveness of error-correct- 
ing codes. Its effect on the error statistics of a Gilbert burst-noise channel 
were noted in Ref. 5, p. 1987. 
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Fig. 11 — P(^ f»,n) for m = 1, 



10. 



With interleaving, the blocked bits from the data source are rearranged 
(by some delay and storage device) and put onto the line so that of two 
originally adjacent bits in a block, the second is the tth bit on line 
following the first. The number t will be called the "interleaving con- 
stant." When t = 1 there is no interleaving. We let n be the block 
length, and for error-rate considerations we are concerned with the 
probabilities P t (m,n) that m bit errors occur among the n bits of an 
interleaved data block. For Pi(m,n) we write simply P(m,n) as before. 
Thus, P t (m,n) is the probability of m errors among n bits which are 
equally spaced with t — 1 other bits between each two. 

To obtain m errors among n bits spaced t — 1 bits apart, we must 
have r errors in the total block of In bits where m ^ r ^ (t — \) n + m. 

Given a total of r errors in tn bits, there are ( )( ' ) collections of 

\?7l/ y ft ?rl/ 

n bits (from the total) containing m errors. There are, however, f J 
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possible collections of n bits. The probability that n bits selected from 
the tn bits contain m errors is hence 



/r\/tn - r \ ^ /tn\ 

\mj \ n — m) ' \ n) 



and, assuming that a sample of n regularly spaced bits is similar to a 
random sample of n bits, we may conclude that 

(r\(tn-r\ 

(t-l)n+m III I 

P t (m,n) « J2 X ) v P(r,tn). (1) 







This formula could be used to approximate P t (m,n) from the P(r,tn) 
values, except that N = tn may be quite large and the computation 
of P(r,N) then becomes infeasible even with the efficient programs used 
in connection with our mathematical model of the telephone network. 
Let us abandon this approach. 
Now, P(r,N) is expressed by 

P(r,N) = S XiP^N) 

where P'(r,N) is associated with the renewal channel determined by 
the gap-length distribution p(j). If we interleave on one of these re- 
newal channels, we effectively have another renewal channel deter- 
mined by a modified gap-length distribution pt % (j). Expressions for this 
will be given below. Thus, 

3 

Pt(m,n) = £ XiPfimv) (2) 

where Pt(m,n) is obtained from pt(j) in the same way that p\r,N) 
is obtained from p*(j) and involves only modest computations. 

Using (2) we are then capable of computing the P t (m,n) values for 
the switched telephone network that are displayed and discussed below. 

For a renewal channel the gap-length distribution p(j) specifies the 
probability Pr(0 3 ~ 1 | 1) that, given a bit error, the next error is the 
jth following bit. (The superscript i is dropped from p(j) here, since 
the three cases i = 1 to 3 are treated the same.) Let a be the autocor- 
relation function for the process so that a(j) = Pr (al | 1) where a is 
any binary word of length j — 1. Then 

o(l) = p(D 
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and 



i-i 



a(j) = PU) + £ P(s)a(j - s) 



(3) 



for j > 1. 

Now, if we interleave with a constant t, error bits remain renewal 
events and p t (j) is the probability 

Pr (ai0a 2 ••• aj-iOajl \ 1) 

that looking at every tth bit there are j — 1 correct bits preceding the 
next error (ai , a 2 , •••,«; are arbitrary binary sequences of length 

t - 1). 




'10 " w* 

INTERLEAVING CONSTANT, t 



Fig. 12 — Gap-length distribution pt 3 (j) vs t. 
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Thus, 



Pid) = a(t) 



and 



;-l 



Vt(j) = a(tj) - 2 a(ts)p t (j - s) 



(4) 



for j > 1. 

This last equation follows from the fact that the first term on the 
right is the probability that the tjth. bit following an error is also in 
error, and the second term is the total probability that at least one of 
the tth, (2i)th, • • • , (j ' — l)tth bits is in error. Their difference then is 

piO')- 

We reintroduce the superscript i ( = 1,2,3) on p*(j) to denote re- 
spectively the initial, intermediate and hump gap-length distributions 
given in Table I. The corresponding autocorrelation functions deter- 
mined by (3) turn out to be well approximated (at multiples of 25) by 
the following formulae. 

a 1 0-25) = 1.43 X 10~ 13 { 2.295 X lO" 11 }*" 1 

a 2 0"-25) = 0.990(1.863 X lO -1 }*" 1 

a s (j -25) - 0.407{0.763} j ~\ 



Table V — Gap-Length Distributions pj(j) 
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3 
4 
5 









0.01 






0.41 
0.14 
0.05 
0.02 
0.01 


50 


1 
2 
3 
4 








0.0002 





0.31 

0.08 
0.02 
0.01 


100 


1 
2 
3 












0.18 
0.03 
0.005 


200 


1 
2 
3 












0.06 

0.004 

0.0002 


400 


1 
2 










0.008 
0.0001 
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Using (4), these give rise to the following gap-length distributions 
p t *(j) (for t = 25, 50, 100, 200 and 400) shown in Table V (therein 
indicates a number less than 10" ). 

To illustrate further the dependence on / we have plotted p t 3 (j) 
(j = 1 to 8) in Fig. 12. 

Using the gap-length distributions in Table V, we have computed 
P t (n,m) for n = 15, 31, 93 to obtain jP«(= m,n). These are summa- 
rized in Figs. 13 and 14, which give PtC^ w,31) vs t for m = 1 to 7 
and P t ( ^ 3,n) vs n for the values of t in Table V. 

The correction of all single and double errors is generally considered 
to be a reasonable procedure for capable codes of almost any block 
length. For such codes, the probability P e of a decoding error cannot 




10 " 10' 

INTERLEAVING CONSTANT, t 



Fig. 13 — Pt(^ wi.31) vs t for m = 1, ■ • ■ ,7. 
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Fig. 14 — P t (^ 3,n) van. 

exceed P<(^ 3,?i), where n is the code's block length (and the inter- 
leaving constant is /). 

Noting Fig. 13 and considering the Bose-Chaudhuri (31, 21) code, 10 
which corrects all double errors, we conclude that interleaving with 
t = 300 would provide an error rate P e of 10 -7 or less. Such error rates 
are usually acceptable. The storage capacity required to obtain t = 300 
for this block length is 31 X 300 = 9,300 bits. 



VII. CONCLUSIONS 



Representation of the telephone network by a combination of re- 
newal-type channels may be accomplished by the specification of 
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slightly more than a dozen parameters. This has the advantages of being 
compact and convenient, and of admitting to extrapolation to large 
block lengths and giving accuracies which are more than adequate for 
most error-control evaluations. 

Interleaving on the telephone network can significantly enhance the 
error-control effectiveness of error-correcting codes when the separation 
between adjacent bits of a code word is on the order of several hundred 
bits. The storage requirements for achieving such interleaving are ex- 
cessive for general application, but, where computers or other special 
storage facilities are available, interleaving can provide an interesting 
trade-off between decoding complexity and simple storage. 
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